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Background / Context: 

As discussed in the first paper in this symposium, the Opportunity NYC-Family Rewards 
project experimentally evaluated the effects of rewarding certain health, education, and work 
activities with cash that was paid directly to families, partially to see how relieving the stresses 
associated with poverty might affect child outcomes such as behavior and sehool proficiency. 
This paper will present findings from the qualitative component of the Family Rewards study. 
Part of the rationale for the Family Rewards experiment was in fact to test how families might 
respond to ineentives without extensive support or guidanee, and program designers had no 
explieit expeetations about how families would embrace an “ineentives-only” program in 
praetice. In this way, a good deal of Family Rewards “implementation” oceurred within families 
themselves. 

One especially important topic around program implementation relates to family patterns 
of communieation related to rewards. Although there were multiple ways that Family Rewards 
designers envisioned the conditional cash transfer (CCT) improving student performance (see 
Figure 1), the program’s most direct route to influenee educational outcomes was to incentivize 
test scores and attendance - the conditions on the program’s “Activity List.” At the same time. 
Family Rewards oriented parents and not ehildren to the program, and gave parents the rewards 
for elementary and middle school students’ aehievement. This meant that parents of elementary 
and middle sehool students were free to decide how much or how little to explain about the 
program, directly influencing their ehild’s understanding of Family Rewards. Beeause of these 
factors, how families eommunicated about rewards helped determine how ehildren understood 
the program, and how prominent the program was within family dynamics. This topic of 
communication is also important because researeh has shown that the way rewards are framed 
may influenee their reception (Kahneman and Tyersky, 1979; Tyersky and Kahneman, 1981). 

Purpose / Objective / Research Question / Focus of Study: 

Aimed at low-income families in six of New York City’s highest-poverty communities, the 
Family Rewards program ties eash rewards to a pre-speeified set of activities. This paper 
presents the qualitative findings from interviews with 77 families. It examines how families 
incorporated the program into their households, and specifically the techniques parents used to 
communicate with children about the rewards, and how ehildren reacted to the edueation 
incentives. Specifically, we ask: (1) How did parents explain Family Rewards to their 
elementary, middle, and high sehool aged children? (2) What did children retain about the 
program rules and goals, and what were their views on receiving monetary incentives for sehool 
performance? (3) How did pre-existing tension in parent-ehild relationships influence parents’ 
abilities to communicate with their child about Family Rewards? 

Setting: 

The intervention was aimed at low-income families in six of New York City’s highest 
poverty eommunities in the Bronx, Brooklyn, and Manhattan. 

Population / Participants / Subjects: 

The eore study involved approximately 4,800 families, half of whom eould reeeive the 
cash incentives if they meet the required conditions. Data for this report rely on 156 structured 
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interviews with 77 families in the program group over a period of 2 years. To seleet partieipants, 
a random sample of program group members was drawn within eaeh community district, and 
was stratified so as to ensure coverage of children who entered the program in the fourth, 
seventh, and ninth grades - the special targets of the intervention, although all children in the 
household were eligible for rewards. Three rounds of interviews were conducted, with 77 
families interviewed in the first round, 44 families were then re-interviewed in the second round, 
and in the third round 39 children from 30 families were interviewed. 

Intervention / Program / Practice: 

Opportunity NYC-Family Rewards was launched by the New York City’s Center for 
Economic Opportunity in 2007 as a three-year intervention. It is a two-generation CCT program 
designed to encourage changes in parents’ and children’s behavior by offering rewards (cash 
payments) for behavior in three key areas: family preventive health care practices (e.g., going to 
well-child visits), children’s education (e.g., attending school regularly, attaining particular 
scores on standardized tests), and parents’ workforce efforts (e.g., full-time work). Rewards for 
parental behavior and younger children’s behavior were paid directly to parents. Rewards for 
older children’s behavior were split between children and parents (see Abstract 1 for more 
details). 

Research Design: 

In addition to the larger Opportunity -NYC - Family Rewards project, intensive 
interviews were included in the research design. To develop the universe of potential 
interviewees, a random sample of program group participants was drawn from each community 
district covered in the demonstration, stratified by the “target” or index grade of the child, with 
equal numbers in the fourth, seventh, and ninth grades. Outreach, sample characteristics, and 
analyses are described below. 

Data Collection and Analysis: 

Information was collected via intensive one-on-one interviews. All potential participants 
were mailed letters describing the research, and outreach workers conducted follow-up calls 
during the day and the evening to ensure a balanced sample in terms of those who were working 
and not working. Scheduling resulted in 77 families in Wave 1 interviews, conducted almost 
exclusively within participants’ homes, with some in MDRC offices when participants’ work 
schedules were conducive to such a meeting. Wave 1 interviews were conducted between April 

2008 and May 2009. These families were fairly representative of the program group on a range 
of relevant characteristics (see Table 1). 

Because the program’s theory of change was that benefits to participation could accrue 
over time, researchers attempted to conduct follow-up interviews within the same sample so as to 
trace these longitudinal dynamics within families, approximately one year later. Making contact 
again with families was somewhat more challenging, as some families had moved, and many 
others had phones disconnected. Special effort was made to reach those participants who 
described themselves as being less engaged with the program during the Wave 1 interviews, by 
leaving letters and postcards directly under their door, but there was little response from this 
particular group, suggesting that some families had disengaged from the program at that point. 
However, forty parents were re-interviewed during Wave 2 interviews, conducted between May 

2009 and February 2010. As a result of outreach dynamics, in the second wave of interviews. 
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participants tended to be somewhat less advantaged (in terms of ineome and disability status) and 
also somewhat more engaged with the program (in terms of the amount of rewards aeerued) than 
the program group as a whole. 

These families were the basis for a third round of interviews, condueted direetly with 
children in the household. Students who entered the program in the fourth, seventh, and ninth 
grades were espeeially solieited, but in many eases families were interested in having all children 
speak to interviewers. As a result, 39 ehildren in 30 families were interviewed during the period 
of October 2009 and April 2010. All interviews were reeorded and transeribed, and were 
subsequently eoded and analyzed using NVIVO 8, whieh allowed inter-rater reliability checks. 

Findings / Results: 

The qualitative study provides insight on how parents eommunieated with their ehildren 
about Family Rewards. Parental deeisions around how to eommunieate with their ehildren about 
Family Rewards greatly influeneed the ehild’s understanding of the program. As important as the 
basie knowledge that parents shared with their ehildren, was the way parenting style and general 
family eommunieation interacted during eonversations around Family Rewards. In families that 
already were experieneing tensions in parent-child relationships, parents were less able to 
ineorporate the program into their regular eommunieation and more likely to ehoose to limit the 
ehild’s knowledge of Family Rewards. As a result of all these faetors, levels of eommunieation 
varied greatly from family to family. However, in eases where parents were transparent with 
their child about the rules and goals of Family Rewards, children still reported a vague and 
sometimes inaeeurate understanding of the program. Communieation levels shaped the 
ehildren’s understanding of Family Rewards and potentially affeeted the strength of the program 
in its ability to directly influence a ehild’s aeademic performanee. 

Conclusions: 

Opportunity NYC - Family Rewards was designed to have very little serviee provision or 
case management - leaving the bulk of program “implementation” up to the families. The 
qualitative study sheds light on how families interpreted and integrated Family Rewards into 
their household. The most direet way families eould use Family Rewards was to utilize the 
program as an ineentive to eneourage ehildren to improve in sehool. However, to effeetively use 
the program as an incentive, parents needed to find ways to eommunieate about the rewards to 
motivate aehievement, and develop reward systems to reinforee their efforts. Parental decisions 
around how to communicate with their ehildren about Family Rewards greatly influeneed the 
ehild’s understanding of the program. Low levels of eommunieation between parents and 
children suggest a need for program implementors to provide parents with different tools to help 
them talk about ineentives with children of different ages, with different personalities, and with 
different levels of aeademie readiness. Finally, beeause parents may not ehoose to use these tools 
within households, next-generation CCTs may also wish to eonsider more direet engagement and 
marketing of incentives to ehildren. 
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The Opportunity NYC Demonstration: Family Rewards 

Table 1.1 

Characteristics of Qualitative Interview Respondents 



Wave 1 Wave 2 Program 

Characteristic Respondents Respondents Group 



Parent's baseline measures 



Currently at least one parent is working (%) 


41.5 


36.4 


45.9 


Annual household earnings ($) 


8,901 


6,401 


9,880 




Living in public housing (%) 


31.5 


28.2 


30.4 


Receiving Section 8 rental assistance (%) 


23.3 


25.6 


21.7 


Receives pubEc housing or Section 8 rental assistance (%) 


54.1 


52.5 


50.8 




Has a physical or mental condition that limits work (%) 


28.1 


36.4 


27.3 


Primary language sp oken at home is Sp anish (%) 


17.6 


15.0 


21.9 




X 

Tarset chiUren's baseline measures f/ol 










4th grade in year 1 


28.8 


32.5 


33.1 


7th grade in year 1 


34.3 


30.0 


31.6 


9th grade in year 1 


37.0 


37.5 


35.3 




Met English learning standards, year 1 


45.1 


55.0 


38.8 


Met math learning standards, year 1 


56.3 


70.0 


56.2 




Summary of rewards earned by families 








Average amount of rew ards e ame d in ye ars 1 and 2 


6,714 


7,171 


6,183 







Sample size 7^ 40 2,377 



SOURCES: MDRC calculationsusing Family Baseline Information Forms, administrative records 
from New York State, N ew York City Department of Education administrative re cords, andSeedco's 
FamilyRewards program data. 

NOTES; Wavel interviews were conductedbetweenApril 2008 andMay2009 . Wav2 interviews 
were conducted betweenMay 2 009 andFebruary2010. 

InNew York State, studentswho score at a level of 3 orhi^er ona4point scale are deemed 
"proficient." 

Sample sizes m aybary because of missing values. 

Roundingmaybause ^^t discrepancies in calculating sums. 

Yearl and2 cover the 2007-2008 and2008-2009 school years, respectively. 

*Grades4, 7, and9 are "target grades" forthe Family Rewards program, and so all families have a 
child m grades 4, 7, or 9. 
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The Opportunity NYC Demonstration Family Rewards 
Figure 1.2 

Ways Family Rewards may Support 
E durational Achievement through F amily Dynamics 



Communication and encouragemenS’ aients 
communicate about incentive? children re sp one! 
rewards “systems” are created. (Chapter 2) 



Program appeals 
to underlying 
educational 
values and 
aspirations 
within families 
(Chapter 1) 



Parental engagement Faienis support children’s efforts 
in the home? through school engagement and by using 
tutors and other help. (Chapter 3) 



Educational outcomes 

Greater educational 
achievement as seen in 
standardiz e d te st? 
attendance grade 
promotion, advancement 
and graduation(for high 
school student^. 



Increased wellbeing. Reduced stress removes barriers to 
educational accomplishment supports linkage between 
aspirations and activities (Chapter 4) 
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